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Traffic simulations are made more realistic by giving individual drivers intentions, i.e. 
an idea of where they want to go. One possible implementation of this idea is to give 
each driver an exact pre-computed path, that is, a sequence of roads this driver wants 
to follow. This paper shows, in a realistic road network, how repeated simulations can 
be used so that drivers can explore different paths, and how macroscopic quantities such 
as locations of jams or network throughput change as a result of this. 
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1. Introduction 

It is by now clear that large-scale microsimulations of transportation syste: 
simulation speeds of 1 millions or more vehicles in real time, are possible 
It is less clear how to "drive" these simulations, i.e. according to which rules the 
individual vehicles know where they are headed. 

Random turning choices at intersections, as they would probably be favored by 
the Statistical Physics community, do not work well: They are already unable to 
represent a simple situation where the traffic in, say, North-South direction is more 
important than traffic in the other directions. 

Traffic science traditionally uses turning percentages (see, e.g., Ref. i), i.e. a 
table for each direction of each intersection which says which fraction of vehicles 
would go left, straight, right, etc. Apart from the problem of how to collect all the 
necessary data from the real world, this is only useful for representing the status 
quo, but useless if one wants to study changes in the transportation system, because 
the turning percentages change immediately. 

The only way out seems to give individual drivers intentions, i.e. an idea of 
where they want to go. One possible implementation of this idea is to give each 
driver an exact pre-computed "plan" , i.e. a sequence of roads this driver wants to 



r an exact pre-computi 
jM See, e.g., Refs. II 



follow uu See, e.g., Refs. UU for an alternative method. 
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Pre-computed trip plans do not allow an adjustment during the trip. To make 
up for this, the simulation can be run several times (periods/days), and simulated 
drivers can make different choices each day, until they settle down on a choice which 
is favorable for them. T his s eems to be a reasonable approach for recurrent (e.g. 
rush-hour) congestion. EJJtiJO 

This paper describes such a simulation using the freeway network of the Ger- 
man Land Northrhine-Westfalia (NRW). There are many travelers with different 
origin-destination pairs. Travelers have route plans (paths) so that they know on 
which intersections they have to make turns in order to reach their destinations. 
In the simulation setup described in this paper, each traveler has a choice between 
10 different paths. Each traveler chooses a path, the microsimulation is executed 
according to the plans of each traveler (no re-planning during the trip), and each 
traveler remembers the performance of his/her option. 

Each traveler tries each option once. Afterwards, she usually chooses the option 
which performed best in the past, except that, with a small probability p 'other, 
another option is chosen randomly, in order to update the information about these 
other options. 

This approach — giving each agent a set of options and let each agent act on 
the basis of the performances of these options — is a simplified version of Holland's 
classifier systemsElsee Ref. E3 for an application of these ideas in an economic 
context; and Refs. EjI13 for their use in much simpler transportation problems. 

Section 2 describes the digital road network used for the simulations; section 3 
describes in detail the simulation setup. Section 4 describes simulation results for 
the adaption scheme; section 5 discusses several variations of the basic simulation 
to demonstrate the robustness of the results. Section 6 shows, as one measure of 
effectiveness, the number of vehicles which reach their destination as a function 
of time. Maybe counter-intuitively, after everybody has settled down on a choice 
of path convenient for herself, the overall network throughput is lower than when 
everybody just drives the geometrically shortest path. A discussion concludes the 
paper. 

2. Network 

The simulations are based on a digital version of the freeway network of NRW, 
where some lower level highways (Bundesstrafien) are added in order to prevent free 
ends inside the network. The code is written for parallel computers using message 
passing, in principle for an arbitrary numbers of computational nodes (CPNs). In 
practice, two SparclO workstations, coupled via optical link and using PVM 3.2, 
were used. This indicates that experiments such as the one presented in this paper 
are already possible with a still modest amount of hardware, and that the consistent 
use of parallel supercomputers will allow systematic analysis of much larger systems. 

The network data which is used comes from RickertJ^ (see also Ref. i) as an 
intermediate step of his input data preparation. The original data is a list of nodes 
and a list of edges, where the list of nodes contains all ramps, junctions, and inter- 
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sections, and edges are the connecting segments. In a first step, Rickert deletes all 
nodes of degree two (e.g. ramps). The resulting network is then distributed on the 
two workstations. The heuristic used for this simply cuts the network in east-west 
direction such that the computational load on both workstations is approximately 
the same. For details see Refs. BBO. 

Apart from the network and the individual trip plans, the simulation is kept_as 
simple and straightforward as possible. This includes oversimplified ramps (see 113) 
and single directional lanes, i.e. one lane in each direction. The point of this paper 
is to show the application of simulated individual decision making in a simplified 
transportation context; a more realistic large scale, path following traffic simulation 
is for example documented in Ref. 0. 

3. Specific simulation setup 

A simulation run consists of a simulation initialization and daily iterations. During 
the simulation initialization, at each boundary segment 2000 vehicles are queued up 
to enter the simulation. (Boundary segments are all segments which lead through 
the border of NRW and which are thus connected to the rest of the network only 
at one end.) Each car randomly chooses a destination, which is one of the other 
boundary segments. The probability to choose a certain destination is proportional 
to the fourth power of the Cartesian distance between the origin and the destination 
segment: P (destination) oc (distance) 4 . Obviously, taking the fourth power biases 
this selection towards long trips. Still during simulation initialization, each vehicle 
gets a list of 10 different paths to reach its destination. These lists have been pre- 
calculated for all occurring origin-destination pairs, and contain the 10 geometrically 
shortest paths which do not use the same node twice. 18-20 

After this general simulation initialization, the daily iterations are started. Each 
daily iteration consists of a preparation phase and a traffic micro simulation phase. 

During each daily preparation phase, each vehicle individually decides which 
path to use. In the first day, each vehicle uses the shortest path; during the sub- 
sequent nine days, each vehicle randomly selects one of the not yet tested options. 
Starting at day 10, it usually selects, as mentioned in the introduction, the option 
with the best remembered performance (i.e. with the lowest t arr i V as defined be- 
low). Sometimes, with probability Pother = 5%, it selects one of the other options 
to re-test it. 

Now, the traffic micro simulation phase of the daily traffic dynamics starts. Ve- 
hicles are updated according to the Nagel-Schreckenberg driving logic, 21,22 and they 
change segments when they are at a junction or an intersection. Each vehicle fol- 
lows its plan until it reaches its destination segment, and when it reaches the end 
of that segment, it notes the arrival time t ar riv, i-e. the current iteration step of the 
simulation, which is used as performance criterion for this specific path. 

After all vehicles have reached their destinations and recorded the above infor- 
mation, the next day is started, where all vehicles have the same initial position 
and the same destination as before, but may choose, in the daily preparation phase, 
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Fig. 1. Situation after 400 iterations (top) and after 1400 iterations (bottom). 

Fig. 2. Top: Situation at the "first day" after 6000 iterations (100 minutes), when trips through 
the network are chosen with a fourth order preference for long trips, and when all drivers follow the 
geometrically shortest path. — Bottom: Situation at "day 15" after 6000 iterations (100 minutes), 
for the same initial conditions as for the top figure, but where drivers have "learned" . 

a different path according to the adaption rules described above. 

4. Adaption results 

Fig. |l| shows an example of a simulation after 400 and 1400 seconds. One clearly sees 
how the initially empty network is filled by vehicles coming in from the boundary 
nodes. Each pixel in the plot corresponds to a small region of 30 sites (225 m). Gray 
dots denote that there is at least one car in the region, gray stars mark slightly over- 
critical regions, where at least one car has velocity zero, and black triangles mark 
jams: The density here is above 0.4. 

Fig. H demonstrates the result of the learning algorithm. Both the top and the 
bottom graph use exactly the same initial configuration of cars with their individ- 
ual destinations. Both graphs are snapshots of the situation after 6000 seconds 
(100 minutes). The top figure shows the situation when every driver follows the ge- 
ometrically shortest path. The bottom figure shows the situation on day 15, when 
drivers act according to their previous experiences, i.e. they usually use the path 
where they were fastest in the past. Note some important differences between the 
figures (the geographical names are shown in the figures) : 

• Drivers learn to use A43 from Wuppertal through the Ruhrgcbiet. A43 is not 
contained in any shortest long-distance path. 

• Around Koln, after the learning also the freeway west of Koln is crowded. 

• Al between Wuppertal and Kamen is much more crowded after the adaption, 
with densities above 0.4 at many places. 

• At Kamen, there is now not only a jam for people coming from Hannover, but 
also for people coming from the Ruhrgebiet. 

Generally speaking, people "learn" according to the programmed rules to equilibrate 
the jams, i.e. fast ways around congested areas vanish. 

5. Robustness results 

One of the general questions of a simulation like this is how independent the results 
are from the specific set-up. For that reason, we tested several variations of the 
simulation. 

Day-to-day variations of the general traffic jam patterns are low after day 15. As 
an example, Fig. |^ top shows the same situation as in Fig. || bottom one simulated 
day later. 
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Fig. 3. Top: Same as Fig. ^ (bottom), except that it is one "day" later. — Bottom: Same as 
Fig. ^ (bottom), except that the distance distribution is linear. 



It has been reported from other traffic simulations that it is important how 
the individual agents remember past information. For example, a driver which only 
remembers the last instance of a trial of a routcJnstead of some average performance 
may induce more oscillations into the system.Bj However, in the simulation setup as 
described here, using different memory rules did not lead to any noticeable difference 
in the simulations. The author's intuition is that the stochasticity of the underlying 
microscopic driving logic introduces already enough "fuzziness" into the system 
to avoid such oscillations. Traditional route choice models often bundle multiple 
drivers from the same origin to the same destination in one packet and do thus not 
allow for variability between these. M 

Also, using a smaller bias towards longer distance destinations (Fig. || bottom, 
after adaption) does not change the overall traffic jam structure. 

Obviously, it will be necessary to replace the arbitrary origin-destination-pattern 
of these simulations by more realistic data. Yet, some of the network bottlenecks 
seem generic with respect to transit traffic through NRW: Heavy traffic and conges- 
tion between Wuppertal and Kamen are well known, and, as one sees, a consequence 
of the missing extension of the freeway A4 beyond Olpe. This extension has since 
long been planned; but it leads through environmentally sensitive areas, and it is 
thus under discussion if it will ever be built. Note that the simulation methodology 
presented here can be used to evaluate the utility of such an extension, or what is 
needed to replace it by improvements along existing paths. Or, which traffic streams 
have to be reduced in order to manage with the currently existing infrastructure, 
and how this can be achieved. 

The problems near Krefeld are due to the same bottleneck in North-East/South- 
West direction. It is also known that the Kolner Ring presents a bottleneck. 

Ref. t£l contains more detailed descriptions. 

6. Network throughput 

As a quantitative measure, the accumulated number of cars which have reached 
their destination is counted as a function of time. Fig. |] shows one result, for the 
fourth order distance distribution. Interestingly, the network performance decreases 
after drivers have learned. The probable explanation is that the network becomes 
crowded in a "balanced" way after drivers learn, whereas before, some parts are 
overcrowded and some are rather empty. It is, for example, reasonable to believe 
that, in Fig. || (top), a path from the south - westward around Koln - Wupoertal 
- Kamen - Hannover has higher throughput than in Fig. || (bottom). Refs.lloH 
contain other examples of unexpected or counter-intuitive behavior of traffic sys- 
tems. 



7. Discussion 
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Fig. 4. Accumulated number of cars which have reached their destination. "Days" 1 and 15 
are shown. In day 1, all vehicles drive according to their geometrically shortest path, whereas in 
day 15 everybody has some knowledge of the travel time on different paths and usually chooses the 
fastest one. — Interestingly, the network throughput decreases during the relaxation, indicating 
that indeed something like grid-lock occurs not only in urban traffic, but can also occur in a 
freeway network. 



The simulations of this paper use individual learning and route selection in a simu- 
lated traffic system. This produces a reasonable distribution of the traffic streams, 



lis method is capable to 
also for a dynamic and 



given the initial origin-destination-assumptions. Thus, t 
do the equivalent of the static equilibrium assignment^ 
congested situation. 

It cannot be expected that the simple assumptions yield a completely realistic 
picture of traffic streams; and for an exact comparison with reality no data was 
available. More realistic simulations are the topic of current workBEj Nevertheless, 
it is perhaps astonishing that already such a simple model leads to a reasonable dis- 
tribution of traffic streams. Moreover, the traffic patterns after adaption are robust 
against different statistical distributions for the origin-destination pairs, different 
learning rules, and different days. This supports the expectation that already rela- 
tively few information on realistic trip generation will yield rather realistic results. 
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